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POINT PROCESSES AND 
THE INFINITE SYMMETRIC GROUP. 
PART V: ANALYSIS OF THE MATRIX WHITTAKER KERNEL 



Grigori Olshanski 



Abstract. The matrix Whittaker kernel has been introduced by A. Borodin in 
Part IV of the present series of papers. This kernel describes a point process — 
a probability measure on a space of countable point configurations. The kernel is 
expressed in terms of the Whittaker confluent hypergeometric functions. It depends 
' on two parameters and determines a J-symmetric operator K in L^(R_|_) ® L^(R_|_). 

, It turns out that the operator K can be represented in the form L(l + L)^^, 

where L is a rather simple integral operator: the kernel of L is expressed in terms 
of elementary functions only. This is our main result; it elucidates the nature of the 
matrix Whittaker kernel and makes it possible to directly verify the existence of the 
associated point process. 

Next, we show that the matrix Whittaker kernel can be degenerated to a family of 
kernels expressed through the Bessel and Macdonald functions. In this way one can 
' obtain both the well-known Bessel kernel (which arises in random matrix theory) 

, and certain interesting new kernels. 
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Introduction 

The present paper continues a series of papers by Alexei Borodin and the author: 
[P.I - P.IV]. In [P. VI] we give a summary of the results. We refer to [P-VI] for a 
detailed introduction to the subject and motivation. 

One of the main conclusions of our work can be stated as follows: certain stochas- 
tic point processes, which originate in harmonic analysis on the infinite symmetric 
group, turn out to be close to point processes arising in scaUng limit of certain 
random matrix ensembles. 
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The common feature of the point processes in question is that their correlation 
functions are given by determinantal expressions 



pn{xi, ...,Xn) = dei[K{xi, Xj)], (0.1) 

where K{x, y) is a kernel in two real variables. In principle, all the characteristics of 
such processes can be extracted from the corresponding kernels, though in practice 
this often requires a lot of work. 

Random matrix theory produces a variety of interesting kernels. Among them 
are the Bessel kernel and the Airy kernel, which are expressed through the Bessel 
functions Ji, and the Airy function, respectively. About these kernels, see [F, NS, 
NW, TWl-3]. 

Our work leads to a new family of kernels, which are expressed through the 
Whittaker functions^ - the Whitaker kernel and the matrix Whittaker kernel, both 
depending on two real parameters. 

The Whitaker kernel has been introduced in [P.II] and studied in detail in [P.III] . 
It describes a point process on M_|_ whose 'particles' are accumulated about zero. 

The matrix Whittaker kernel, which is the object of study in the present paper, 
has been introduced in [P.IV]. It describes a larger process, which lives on M\{0} = 
R-i- U R_ . This kernel is conveniently written as a 2 x 2 matrix whose entries are 
kernels (or integral operators) on R^., which explains the term 'matrix kernel'. 

The matrix Whittaker kernel defines an operator in L^(M_|_)©L^(]R_|_) which turns 
out to be J-symmetric, i.e., symmetric with respect to an indefinite inner product 

id 
-id 

a J-symmetric kernel occuring in formula (0.1) for the correlation functions. 

The purpose of the present paper is to try to elucidate the nature of the matrix 
Whittaker kernel and its relationship to other kernels. 

In section 1, we explain some general properties of the point processes governed 
by J-symmetric kernels on a simple model (finite state space). This enables us to 
avoid unnecessary technicalities in questions which are essentially based on elemen- 
tary linear algebra. 

In section 2, we employ the formulas of section 1 as a prompt to derive the 
following result about the structure of the matrix Whittaker kernel (Theorem 2.4). 
Let K denote the J-symmetric operator in L^(M_|_) ©L^(R+) mentioned above. We 
show that the operator L = K{1 — K)~^ has the form 



[f,9] = {Jf,9); specifically, J 



Perhaps, this is the first example of 



L = 



A 
-A' 



(0.2) 



where A is a real integral operator on and A' is the transposed operator. It 
is worth noting that the kernel of A is given by a simple expression involving no 
special functions at all; the Whittaker functions arise when we pass from L to K. 

The passage from JC to L is not a pure formal trick. As is explained in section 
1, in a simpler situation of processes with finite point configurations (which is not 
the case of our process on UM_), the operator L has a clear meaning: its kernel 



^The Whittaker functions are certain confluent hypergeometric functions. They are eigenfunc- 
tions of a second order differential operator on the semiaxis a; > and have exponential decay as 

X — > +00. 
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describes the distribution functions of the process in the whole state space. In such 
a situation, vanishing of the diagonal blocks of L also admits a nice interpretation 
(see Proposition 1.7). 

For our process, the point configurations are almost surely infinite, and the basic 
formula expressing the distribution functions in the whole state space through the 
operator L (see (1.1)) becomes incorrect. However, it is tempting to combine it with 
the simple expression for the operator L given in Theorem 2.4 to derive meaningful 
conclusions about our process. In this direction, we (Borodin and I) have some 
conjectures but no rigorous results. 

Section 3 is devoted to the spectral analysis of the matrix Whittaker kernel 
K{x,y). We exhibit a continual basis in L^(R+) ® L^(]R+) diagonalizing the cor- 
responding operator K. The elements of this basis are (within a simple factor) 
certain Whittaker functions; they are eigenfunctions of a Sturm-Liouville differ- 
ential operator. This result provides additional information about the nature of 
the matrix Whittaker kernel K{x,y). It also provides a way to verify directly that 
K{x^ y) obeys certain conditions that ensure the existence of a point process with 
the correlation functions (0.1). 

In section 4 we deal with the 'tail process'. This point process is a stationary 
process on M U M. It describes (via an appropriate scaling limit) the asymptotical 
behavior of our initial random configurations on U ]R_ near zero. This extends 
the results of sections 3-4 of [P.III] . 

In section 5 we study the matrix Whittaker kernel K{x,y) from another point of 
view: hierarchy of special functions of hypergeometric type. It is well-known that 
the Whittaker functions can be degenerated to the Bessel functions. Employing 
this fact, we compute a scaling limit of the kernel K[x,y). The limit transition is 
rather curious: we let one of the two parameters of the kernel, a, tend to infinity 
inside the set of the form ao + 2Z with ao € K fixed. As a result, we get a (still 
two-parametric) family of matrix kernels expressed through the Bessel functions of 
the first kind J^, and the modified Bessel functions of the third kind (Macdonald 
functions) K,,. Taking the diagonal blocks, we get two sorts of kernels on R+: one 
(expressed through the functions Ji^) is a slight generalization of the conventional 
Bessel kernel [F, NS, NW, TW2], and another (expressed through the Macdonald 
functions Ki,) is, perhaps, a new example; we called it the Macdonald kernel. 

It would be interesting to understand whether the Macdonald kernel is somehow 
related to random matrix ensembles. 

I am grateful to Alexei Borodin for numerous discussions and to Craig A. Tracy 
for drawing my attention to the papers [MTW], [T], [TW4]. 

1. A MODEL 

In this section we fix a finite set X which will serve as a "state space". We 
shall deal with kernels K{x,y), L{x,y) on X x X which will also be considered as 
matrices of order |X| with the rows and columns indexed by the elements of X. 
The kernels can be real or complex. We take the counting measure on X and form 
the corresponding (finite-dimensional) Hilbert space L^(X). Any kernel defines an 
operator in L^(X); we shall denote it by the same letter as the kernel. 

Let S stand for the space of configurations in X with no multiple points. Thus, 
a configuration is simply a (possibly, empty) subset ^ C X, and the total number 
of configurations is equal to 21-^1. 
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Let L{x,y) be a kernel on X. For a configuration ^ we shall denote by the 
submatrix in L formed by the rows and columns from ^, so that det is a principal 
minor of L. We agree that detL0 — 1. 

Proposition 1.1. Assume L is a real or complex kernel on X such that all its 
principal minors det are real and nonnegative. Then there exists a probability 
distribution on S with the weights 

Note that the assumptions on L imply that the matrix 1 + L is invertible. 

Proof. This is easy. □ 

We shall consider this probability distribution as a point process on the (finite) 
state space X. The next step is to look at the correlation functions. 

Proposition 1.2. The correlation functions of the above process are given by the 
determinantal formula 

Pn{xi, . ..,Xn) ^ det[i^(a;i, Xj)]i<ij<n , (1.2) 

where n = 1, 2, . . . the points xi, . . . ,Xn are pairwise distinct, and K is given 
by K = L(l + L)-i. 

Proof. An elegant proof based on the generating functional of the process is given 
in [DVJ], Exercise 5.4.7. □ 

We shall always assume that K and L are related to each other by the transfor- 
mations 

K = L{l + L)-\ L = K{1- K)-\ (1.3) 

which are well-defined provided that the matrices 1 + L and 1 — K are invertible. 

Proposition 1.3. Assume L is Hermitian nonnegative: L — L* > 0. Then L 
satisfies the assumptions of Proposition 1.1 and K is Hermitian satisfying < 
K < 1. Conversely, if K is Hermitian and < < 1 then the corresponding L 
exists and is Hermitian nonnegative. 

Proof. This follows from (1.3). □ 

Thus, we dispose of a family of (finite) point processes governed by the Hermitian, 
nonnegative, strictly contractive kernels K. Or, equivalently, by the Hermitian 
nonnegative kernels L. 

Henceforth we fix a partition of X into disjoint union of two subsets: 

X = X\ U X2., 

we decompose the Hilbert space LP'{X) into the direct sum 

L'{X) = L^{Xi)®L^{X2), (1.4) 
and we write any kernel (matrix) ^ on j£ in the block form 

\_A21 A22 \ ' 
4 



where Aij acts from L'^{Xj) to L^(Xi). 

We endow the space L^(X) with the indefinite inner product determined by the 

matrix ^ . A kernel A is called J-Hermitian if the corresponding operator 

is Hermitian with respect to the indefinite inner product. Equivalently, in terms of 
blocks, 

(An)*=An, (A22)*=A22, (Ai2)*--A2i. (1.5) 

Note that if one of the kernels K, L is J-Hermitian, and the correspondence 
(1.3) makes sense, then another kernel is J-Hermitian, too. 

Proposition 1.4. Assume that L is J-Hermitian and the diagonal blocks Ln, L22 
are nonnegative. Then all the principal minors det are real nonnegative. 

Proof. Replacing L by L + el, where £ > is arbitrary, we may assume that 
the diagonal blocks Ln, L22 are strictly positive. We shall prove that under this 
assumption, all the principal minors detL^ are strictly positive. Next, replacing L 
by , we remark that it suffices to prove this claim for det L only. 

Thus, we have to prove that det L > provided that L is J-Hermitian and 
Lii > 0, L22 > 0. We employ the well-known formula for the determinant of a 
block matrix, 

det L = det Ln • det(L22 — L2iL^i L12) 

which makes sense because Ln is invertible. We have 

Lii > 0, L22 — L2iL^^Li2 = L22 + LI2L1IL12 > , 

which implies that the both determinants are strictly positive. □ 

Proposition 1.5. In terms of blocks, the correspondence L ^ K takes the follow- 
ing form. 

The transform L ^ K: 

= (Ln - Li2(l + L22)-'L2i)(l + i^ii - i^i2(l + i^22)-'i^2i)-' (1.6a) 

i^22 = iL22 - l>2i(l + Ln)-'Li2)(l + L22 - L2i(l + Lu)-^L,2)-^ (1.6b) 

Ki2 = (l-Kll)Ll2(l+L22)"' (1.6c) 
K21 = (1 - K22)i^2l(l + i^ll)"' . (1.6d) 

The inverse transform K ^ L: 

Lii = (Kn - Ki2(l + K22)-'i^2i)(l + i^ii - i^i2(l + K22)-'K2i)-^ (1.7a) 

L22 = (i^22 - i^2l(l + i^ll)-'i^l2)(l + i^22 - i^2l(l + i^ll)-'i^l2)-' (l-Tb) 

L12 = (1 + Lii)Ki2(l - K22)-' (1.7c) 
L21 = (1 + L22)i^2i(l - K^i)-' . (1.7d) 
Here we assume that all the necessary inverse matrices exist. 

Proof. Write the equality K = L(l -|- L)~^ or, equivalently, K{1 -\- L) = L in terms 
of blocks: 

Kii(l + Ln)+i^i2L2i =Ln 

K11L12 + Ki2{l + L22) = L12 
-^22(1 + -^22) + -^21-^12 = -^22 
K22L21 + i^2l(l + -^^ll) = L21 . 



From this system one readily gets the relations (1.6a-d). 

The second group of relations, (1.7a-d), is verified in exactly the same way. □ 

Proposition 1.6. The transforms L ^ K and K ^ L define a bijective corre- 
spondence between 

(i) the J-Hermitian kernels L such that Ln > 0, L22 > 0, 

and 

(ii) the J-Hermitian kernels K such that Kn < 1, K22 < 1? 

+ i^i2(l - K22)-'K2i > 0, K22 + i^2i(l - i^ii)-'i^i2 > (1.8) 

(note that the latter two inequalities are stronger than Kn > 0, K22 > 0^. 

For these two sets of kernels all the inverse matrices in the formulas of Proposi- 
tion 1.5 exist. 

Proof. We have 1 + L22 > 0, so that 1 + L22 is invertible. Further, the matrix 

Pii '■— Lii — ^12(1 + -^22) ^-^21 = Lii + Li2(l + L22) ^-^12 
is nonnegative. Since the expression (1.6a) for Kn is equivalent to 

i^ii =Pii(l + Pii)-', 

it makes sense and, moreover, < Kn < 1. Likewise, the expression (1.6b) for ^22 
also makes sense and we have < ^22 < 1- Consequently, the expressions (1.6c-d) 
for K12 and K21 also make sense. Thus, the transform L 1-^ ii' is well-defined. 
Now look at the relation (1.7a). It can be written as 

Lii = Qii{l — Qii)~^, 

where 

Qll = i^ll + Xl2(l-i^22)-'i^21. 

We have 

1 - Qii = 1 - - Ki2{l - K22)-^K2i = (1 - Kii) + ^12(1 - K22)-^K^2 > 0, 

because Kn < 1. Since Ln > 0, we conclude Qn > 0, which is the first inequality 
in (1.8). It is stronger than Kn > 0, because Qn > means 

Kii-{Ki2il-K22)-^K*2)>0. 

Likewise, we establish the second inequality in (1.8). 

Thus, the transform L ^ K sends any matrix L satisfying (i) into a matrix K 
satisfying (ii). The inverse transform is justified in the same way. □ 

Proposition 1.6 is a generalization of the trivial Proposition 1.3. Together with 
Proposition 1.4 it yields a class of finite point processes for which both the kernels 
L and K are given explicitly. We recall that L describes the distribution functions 
(see (1.1)), while K describes the correlation functions (see (1.2)). 

Now we shall impose more special conditions on L: we shall assume that Ln = 0, 
L22 = 0. The meaning of this restriction is demonstrated by the following result. 
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Proposition 1.7. Consider the process governed by a J-Hermitian kernel L with 
Lii > 0, L22 > 0. Then the condition Ln = 0, L22 = exactly means that the 
process is concentrated on the configurations ^ C X with the property 

l^nXil = l^nXal- (1.9) 

Proof. Assume Ln = 0, L22 = 0, and let ^ be a nonempty configuration. Its weight 
(1.1) is proportional to the value of the principal minor det L^. Remark that is a 
block matrix whose diagonal blocks are zero. Such a matrix can be nondegenerate 
only if the blocks are of the same size, which means (1.9). 

Conversely, let (1.9) hold. The diagonal blocks Ln, L22 are nonnegative, so that 
if one of them is nonzero, then it has a nonzero diagonal entry. That is, there exists 
a point x e 3£ such that L(x, x) > 0. But then the one-point configuration ^ = {x} 
has a nonzero weight which contradicts to the assumption (1.9). This contradiction 
implies that the diagonal blocks must be zero. □ 

Proposition 1.8. The transforms L K and K L define a bijective corre- 
spondence between 

(i) the kernels L of the form 

A' 
-B 



L = 



(1.10) 



where the matrix 1 + AB is invertible (equivalently, 1 + BA is invertible) 
and 

(ii) the kernels K of the form 

CD C ' 

DCD - D DC 



K = 



(1.11) 



where 1 — CD is invertible (equivalently, 1 — DC is invertible). 
In terms of the blocks, this correspondence takes the form 



C = {1 + AB)-^A = A{l + BA)-^, D = B, (1.12a) 

A = C{1- DC)-^) = (l-CD)-^, B = D. (1.12b) 

In particular, 

1-CD=(1 + AB)-'^, 1-DC=(1 + BA)-^. (1.13) 

Proof. This is a direct consequence of the formulas of Proposition 1.5 and the 
identity 

X{1±YX)-^ = {1±XY)-^X. (1.14) 

Indeed, take the kernel L of the form (1.10). Applying (1.6a-d) we get 

'AB{1 + AB)-^ {1 + AB)-^A ' 
-{1 + BA)-^B BA{1 + BA)-^ 

Using the identity (1.14) we verify that K has the desired form with C, D as indi- 
cated in (1.12a). 

Conversely, starting with the kernel K of the form (1.11) and applying (1.7a-d) 
together with the identity (1.14) we readily verify that L has the form (1.10) with 
A, B indicated in (1.12b). □ 

The following corollary will serve as a prompt for the main result of the next 
section (Theorem 2.4). 
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K 



(1.15) 



Corollary 1.9. Let K be a J-Hermitian kernel of the form (l-H). Then 



D* 

Proof. By Proposition 1.8, L is given by the formula (1.10) with B = D. Since K 
is J-Hermitian, L is J-Hermitian, too. This imphes A = B* = D* . □ 

Remark 1.10. Let us return to the very beginning of the section, where we in- 
troduced a class of point processes in X governed by kernels L with nonnegative 
principal minors (formula (l-l))- Let 2) C X be a subset. Given a point process in 
X we can define its 'truncation', which is a point process in 2): the latter process is 
the image of the former under the map ^ i— > ^n2). Clearly, the correlation functions 
of the truncated process are obtained simply by restricting the correlation functions 
of the initial process. So, if the initial process belongs to our class (i.e., is given 
by the formula (1.1)) then the truncated process also belongs to this class, and the 
'truncated' kernel K is obtained simply by restricting the initial kernel K to 2) x 2). 
The corresponding transformation of the kernel L is more complicated. To describe 
it, write the kernel L in the block form with respect to the partition 36 = 2) U 2): 



L = 



Then the transformed kernel is equal to 

This formula follows from (1.6a). 

2. Main result 

Here we shall try to apply the general results of section 1 to the matrix Whittaker 
kernel introduced in [P.IV] . As we shall deal with continual kernels instead of finite 
matrices, we shall need to justify certain steps. 

We take as X the punctured real line M* = M \ {0} equipped with Lebesgue 
measure dx. We write kernels on M* in the block form with respect to the partition 

M* = M+ U M_ . 

We identify M_ with M_|_ via the map x ^ a; < 0, which enables us to 
interpret each block as a kernel on M_|_ and write 

L^{R*) = L'^{R+)®L'^{R+). (2.1) 

Given a kernel, we shall denote the corresponding integral operator by the same 
letter and we shall regard it as a Hilbert space operator. 

We shall introduce the basic notation and then we shall recall the definition of 
the matrix Whittaker kernel from [P.IV]. 

This kernel depends on two parameters z, z' which play symmetric roles. The 
parameters satisfy the following restrictions: 

either z, z' G C\X and z' = z, 

(2.2) 

or 2, G M \ Z and m < z., z' < m + 1 for a certain m e Z. 



Instead of 2;, one can take the parameters a, defined by 



a=^— , /i=^— . (2.3) 

Then the conditions (2.2) take the following form: 

a is always real and is not an integer when = 0; 
is either pure imaginary or real; in the latter case (2-4) 
there exists m e Z such that m + |//| < a < m + 1 — |//|. 

This implies that if is real then < |. 

The Whittaker function Wk,ij,{x), x > 0, with indices k, can be defined in 
terms of the confluent hypergeometric function iFi as follows: 

This expression makes sense when ^ 0; when /j, — (the so-called logarithmic 
case), it can be defined by a limit transition. We have 

W^,^ = W,,-^ . (2.6) 

We shall always deal with a real k and a real or pure imaginary then the Whit- 
taker function takes real values. 

The Whittaker function can be characterized as the only solution of the second 
order differential equation 



which has exponential decay at +oo: 



W^,^{x) = x^e-''/^ (^1 + O ^ , x^ +00. (2.8) 



About the Whittaker function, see, e.g., [El]. 

Let us fix 2;, z' (equivalently, a, /x) and abbreviate 



^ix)=x-'/'e-/'W,^^Jx), (2.9a) 

yp_(x)=x-VV/2W^„_i,^(x), (2.9b) 

^{x) = x-'/\^/^W_,+ .Jx), (2.9c) 

V;-(x) = x-'/'e^/'W_,_^Jx). (2.9d) 



Finally, let 



/—. — 7 — — — 7 — -7 /cos(27ru) — cos(27ra) /„.„s 
a = Vsin(7r^) sin(7r^') = d ^ — ^ ^ (2.10) 



and note that, under our restrictions on the parameters, cr^ is always real and 
strictly positive; so, cr is always real and nonzero. 

The matrix Whittaker kernel, as defined in [P.IV], has the form 



[K] = 



K++ K+_ 



(2.11) 



where the blocks are the following kernels on R+: 

1 <f{x)(p-{y) - (p-{x)(p{y) 



K++{x,y) 
K—{x,y) = 



T{z)T{z') x-y 

1 i;{x)i;-{y) - i;-{x)ip{y) 



K+-{x,y) 



r{—z)T{—z') X — y 

a (f{x)i;{y) + zz'ip^{x)i;-{y) 



TT X + y 

K-+{x,y) = -K+_{y,x) 



(2.12a) 

(2.12b) 

(2.12c) 
(2.12d) 



Note that all the blocks are real kernels and the diagonal kernels K-- are 

symmetric; together with the last relation this implies that [K] is J-symmetric. 

Proposition 2.1. The matrix Whittaker kernel [K] can be written in the form 



[K] 



CD C 
DCD -D DC 



where 



C{x,y) = K+_{x,y), 

-a 

D{x,y) = - 



TT \y J X + y 



(2.13) 

(2.14) 
(2.15) 



and, by definition, the products CD, DC, DCD are superpositions of integral op- 
erators: 



{CD){x,y) = / C{x,s)D{s,y)ds 
Jo 

r+oo 

iDC){x,y)= / D{x,s)Cis,y)ds (2.16) 

/■+00 r+oo 

{DCD){x,y)= / / D{x,si)C{s^,S2)D{s2,y)ds^ds2. 
Jo Jo 

Proof. This is merely a reformulation of the results of [P-IV], section 2. Indeed, let 

Nix,y) = -(-) e-"^ K+_{x,y), Wix,y) = ^ , (2.17) 
TT \yj x + y 

and let i?i and i?2 be the following multiplication operators: 

{Rif){x) = 7ra-'x-''e-/^f{x), (i?2)/(x) = x-'^e'^/^ fix). (2.18) 
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In [P.IV], section 2, it was proved that 



K 



Ri 

i?2 



NW N 
WNW - W WN 







i?2 ^ 



(2.19) 



which means, in particular, that all the integrals involved in (2.16) make sense. It 
follows that [K] has the form (2.13) with 

C = RiNR^^, D = R2WR^\ 

which are exactly (2.14), (2.15). □ 

Proposition 2.2. Assume —1/2 < a < 1/2. Then the integral operator D with 
the kernel D{x,y) as defined in (2.15) is bounded in L'^ (M.^ , dx) . 



Proof. Set 



D'{x,y) 



x + y 



(2.20) 



We have D — {a /ti)MD' M , where M stands for the operator of multiplication by 
the bounded function e~^/^, so that it suffices to check that D' is bounded. 

Passing to new variables ^, ry such that x = e~^, y = e~'^, we transform D' to 
the integral operator in L^(]R, d^) with the kernel 



(2.21) 



Since this kernel is translation invariant, the Fourier transform takes V to a mul- 
tiplication operator. It remains to check that the latter is bounded. 
To this end we employ the formula 



Fourieru 



e-P- J 2/3 cos(7r(-^ + ^)) 
P>0, ^a<P 



1 



(2.22) 



Fourieru{f{v)} = g{u) means g{u) = e^^'"f{v)dv 



where 



see [E2, 3.2(15)]. 

Applying (2.22) we get that after the Fourier transform the operator V becomes 
the operator of multiplication by the function 

TT 



cos(7r(a + iu)) ' 



which is bounded by the assumption \a\ < 1/2. □ 
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Proposition 2.3. Assume —1/2 < a < 1/2. Then the integral operator D with 

the kernel C{x,y) = {x,y) as defined by the formulas (2.14), (2.12c), (2.10), 

(2.9), (2.5), is bounded in L'^{R+,dx). 

Proof. Assume first that A* 7^ 0. Then, according to (2.5), we can write 

x-'/^W^A^) ^x^{...)+x-^{...), (2.23) 

where each of the two expressions denoted by dots is equal to a confluent hypergeo- 
metric function multiplied by an exponential factor and so is analytic on the whole 
real axis. Consequently, the kernel C{x,y) can be represented in the form 

x'^y^a++{x,y) + x^'-'-y^^a {x,y) + x^y~^ajf {x,y)+x^^y^a \-{x,y) 

<-'{x,y) = ^ 

x + y 

where the four functions a_(__|_, a , , a |- are analytic about (0,0). 

The key observation is that 

a++(0,0) = a__(0,0) = 0. 

Indeed, it follows from (2.5) that 

a++(0, 0) = ^ (r(-2^))2 ( — + 



I 



V yY{-z)r{z') r(-^ + i)r(^' + i) 

a__(0,0) = ^ (r(-2^))^ ( —4—- + 



V \^r(-^')r(^) r(-^' + i)r(^ + 1) 

and the both expressions in the parentheses are equal to zero. 
Consider the kernel 

, _ a;^y-^a+_(0,0) + a;-^j/^a_+(0,0) 
^o{x, y) - , 

and set 

C'{x,y) = C{x,y) - X[o,i]{x)Co{x,y)x[o,i]{y), 

where X[o,i] stands for the characteristic function of [0, 1]. The boundedness of the 
integral operator C will follow from the two claims: 

• Claim 1. The kernel Co{x, y) defines a bounded operator in L'^{M.^,dx). 

• Claim 2. The function C'{x,y) is square integrable on R^. 

Indeed, C{x,y) is the sum of X[Q,i]{x)CQ{x,y)x[Q,i]{y) and C'{x,y). Since the 
function X[o,i] is boimdcd, the first summand defines a bounded operator by Claim 
1, and the second summand defines a Hilbert-Schmidt (hence bounded) operator 
by Claim 2. 

Let us check Claim 1. It suffices to show that the kernel 

1 



yj x + y 
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defines a bounded operator. Arguing as in the proof of Proposition 2.2 we reduce 
this to the boundedness of the function 



TT 

cos(^7r// + ITTU) 

Since e zR or — 1/2 < /i < 1/2 this is obvious. 

Let us check Claim 2. It suffices to show that C is square integrable both in the 
square [0, 1]^ and in its complement \ [0, 1]^. 

In the second region, C' coincides with C. Recall that C{x,y) = {x^y) 

(see (2.14)) and look at the expression (2.12c) for K-[ {x,y). Outside [0,1]^, the 

fraction is bounded, so that it remains to prove the square integrability of the 
numerator of (2.12c). To this end it suffices to prove that each of the functions 
(p{x)ip{y), (p-{x)ip-{y) is square integrable in our region. Actually we can claim 
that they are square integrable in the whole quadrant M^. Indeed, this reduces 
to the fact that each of the four functions (p, '0, </?_, is square integrable in 
R+. Each of these functions is of the form x~^/'^Wi^^^{x). The latter function has 
exponential decay at infinity, hence it is square integrable near infinity. Finally, 
near zero, it behaves as indicated in (2.23). Since is either pure imaginary or 
satisfies — l/2<|U<l/2we get square integrability about zero as well. 

Let us examine the kernel C'{x,y) in the square [0, 1]^; here it coincides with 
C{x, y) — Cq{x^ y). By the definition of Co we have 

x^^y^^b++{x,y) + x~^^y~^^b — {x,y) + x^^y~^^b+-{x,y) + x~^^y^^b-+{x,y) I 

C [x, y) — ■ ,| 

x + y I 

where the functions 



b++ix^y) = a++{x,y), b — {x,y) = a — {x,y), 
b+-{x,y) = a+_{x,y) - a+_(0,0), b_+{x,y) = a_+(a;,y) - a_+(0,0) 

vanish at (0, 0). Each of these four functions can be written in the form x{. . .) + 
y{- ■ ■) where the expressions denoted by dots are certain analytic (hence bounded) 
functions. Since the expressions and are bounded, we have to examine the 

functions of the form x'^y^ where e, 5 take the values ±|U. Since fi is pure imaginary 
or |/i| < 1/2, the latter functions are square integrable. This completes the proof 
of Claim 2. 

Thus, we have proved the proposition for the case A* 7^ 0. In the logarithmic case 
fj, = the argument is quite similar; we shall only indicate necessary modifications. 
We have from (2.5) 

x-^/''W^,o = limx-^/^W^^^{x) = lux ■ ao{x) + ai(x), (2.24) 

where ao and ai are certain analytic functions such that 

1 



ao(0) = 



r(|-«) 



ai(0) = -:p7T^(V'(^-«)-2V'(l)), V'(-):=^ 



(2.25) 
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see formulas (6.9(2)) and (6.7(13)) in [El]. From this we get 

Inxlny • aoQ{x, y) + \nx ■ aoi{x, y)+lny- aio{x, y) + aii(x, y) 



C{x,y) 



x + y 



where aoo, aoi, flio, o^ii are certain analytic functions. Further, using (2.25) and 
the well-known relation -0(1 + a) — ilj{a) = we get 

aoo(0,0) = 0, aoi(0,0) = -aio(0,0). 

Now we set 

^ . ^ lnx-aoi(0,0) + ln|/-aio(0,0) (f ) 

Co{x,y) = ■ = aoi(0,0) — ^ , 

x+y x+y 

we define C'{x, y) as above and we state the same two claims as above, which imply 
the proposition. 

To check Claim 1 we again pass to new variables and transform the kernel C{x, y) 

to 

^^^^^ e(l-.)/2Ve-(€-.)/2 • (2-26) 

Employing the formula 

Fourieru { ttt ) = tt — - (2.27) 

\ + J ch2(7rw) ^ ^ 

we get that after the Fourier transform the kernel (2.26) becomes multiplication by 
the function (2.27) times a scalar factor. Then we remark that the latter function 
is bounded. 

As for Claim 2, it is verified in exactly the same way as in the nonlogarithmic 
case: here we employ the fact that the function (2.24) has exponential decay at 
infinity and is square integrable near zero. 

This completes the proof. □ 

Theorem 2.4. Consider the operator K in the Hilbert space L^(]R+, (ix)©L^(M_|_, dx)^ 
defined by the matrix Whittaker kernel (2.11)-(2.12), and assume that the parameter 
a = satisfies the condition —1/2 < a < 1/2. Set 



L 

where 



A 
-B 



(2.28) 



-a _ 'g+y 

a I X \ e 2 



A{x, y) = D{y, x) = - - —— (2.29) 
TT \yj x + y 



a I X \ e 2 



B{x, y) = D{x, y) = A{y, x) = - - —— . (2.30) 

TT \yj x + y 

{Note that L is hounded because D is bounded by Proposition 2.2). 
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Then we have 



(2.31) 



Proof. We know from Propositions 2.2, 2.3 that the kernels C{x,y), D{x,y) (see 
(2.14), (2.15)) define bounded operators C, D. Together with Proposition 2.1 this 
means that in the formula (2.13) for the matrix Whittaker kernel we may interpret 
all the products as products of bounded operators. In particular, this implies that 
K is bounded. 

Furthermore, the fact that the matrix Whittaker kernel is J-Hermitian implies 
the following operator relation: 



K 



CD 
DCD-D 



C 

DC 



D*C* 
-C* 



D' 



- D*C*D' 
C*D* 



(2.32) 



(Here the adjoint operators (...)* coincide with the transposed ones because all 
the operators are real.) 

The desired relation (2.13) is equivalent to K + KL = L, which in turn means 
that 



CD 
DCD-D 



or 



or 



C 

DC 


-D 



+ 



CD 
DCD-D 

C + CDD' 



c ' 







D*' 




DC 




-D 













D*' 


DD* 




-D 







-D 



D* 




C + CDD* = D*, DC + DCDD* - DD* = 0. 

Now, the latter two relations are direct consequences of (2.32). □ 

The result seems to be quite surprising. First, the expression for the kernel 
L is very simple and involves no special functions. Second, let us pass from the 
parameters z, z' to the parameters a, then we see that in (2.28)-(2.30), jj. occurs 
only in the scalar factor a. 

Corollary 2.5. Let a he fixed, —1/2 < a < 1/2. Then the operators K correspond- 
ing to various values of the parameter ji pairwise commute. The same holds for the 
blocks or the blocks K 

Proof. According to (2.29), (2.30) we can write 

A = aAo, B = aBo 

where the operators Aq and Bq do not depend on //. Consequently, 

Ao' 
-Bo 

This means that when /x varies, the operators L differ by a scalar fact only. Since 
K = L(1 + L)~^,we conclude that the corresponding operators K form a commu- 
tative family. 
Next, by (1.15), 

K++^ AB{l + AB)-\ (2.33) 

Since AB = a'^AoBo where AqBq does not depend on fi, the operators AB with 
various /x form a commutative family. So, the same holds for the operators 
For the blocks K the argument is the same. □ 

This suggests the idea to take as the parameters the couple a, a. 
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L = a 



3. DiAGONALIZATION OF THE KERNELS 

Now we are in a position to perform the spectral analysis of the kernel L — to 
"diagonalize" it in a continual basis and hence to "diagonalize" the kernel too. 

Proposition 3.1. The "ordinary" Whittaker kernel with parameters a, /i 

commutes with the Sturm-Liouville differential operator 

i.e., the kernel satisfies the following differential equation 

V{a)^K++{x,y) = ^{a)yK++{x,y), (3.2) 

where the subscript x or y indicates the variable on which the differential operator 
acts. 

Proof. This is a limit case of Proposition 6.2 in [P.III] and can be verified by a 
direct computation. We do not give a detailed proof, because we shall employ this 
result as a prompt only. □ 

It is worth noting that 2) (a) does not depend on fx, which agrees with the fact 
that the kernels with varying /x form a commutative family (Corollary 2.5). 
Consider the following functions on 1R+: 

fa,mix) = - Wa,imix), m > 0. (3.3) 
X 



We have 



^{a)fa,m = (a^ + i + m'')fa,m. (3.4) 



According to [W], the functions fa,m with a fixed and m ranging over 1R+ form 
a continual basis in L^(R+) diagonalizing 2) (a). Moreover, an explicit Plancherel 
formula holds: ^ 

/■ n \ f \f ■> fa,m)\fa,rm 9} j /o r\ 

{f,9)LHR+)= —ji 7 ^ — dm, (3-5) 

Jo \Ja,m: Ja.m) 



where 



{fa,rmfa.m) '■— , i . x-^/ 1 , . x • (3-6) 

r(| — a — zm)r(| — a + im) 



Consider the decomposition (2.1) and take in its first component the basis 
{fa,m}m>o cind in its second component — the basis {f-a,m}m>o- Together they 
form a (continual) basis in the whole space L^(R*). The following claim describes 
the diagonalization of L in this basis. 

Theorem 3.2. Let A and B be as in (2.29), (2.30), and assume that \a\ < \. 
Then we have 

Af-a,m = - r(^ - a + im)r(^ - a - im)fa,m (3.7a) 
Bfa,m = - r(i + a + im)T{\ + a - im)f-a,m- (3.7b) 

TT Z Z 
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Proof. The function Af_a,Tn is essentially the Stieltjes transform of the function 

y-""-^ exp{-^y)W_a,im{y)^ 

which is given, under the assumption 3?(— a) > in [E2, 14.3(53)]. The expres- 
sion for B = A* is obtained in the same way; here we need 3?(a) > — |- Thus, we 
have entirely used the assumption |a| < |. □ 

Remark 3.3. We have 

cos(27r/x) - cos(27ra) ^ 
cos(27rzm) + cos(27ra) 

This shows that a = ±| are "critical" points: when \a\ < |, the operator AB = 
AA* is bounded as its spectrum is bounded, whence A and B are bounded. But in 
the limit a — > ±| the spectrum of AB becomes unbounded. 

Employing (2.33), we get, as a corollary of (2.18), a diagonalization of 

Corollary 3.4. Assume |a| < i. We have 

_ cos(27r//) — cos(27ra) 
cos(27r//) + cos(27rzm) 

Remark 3.5. The operator A for a = arose before in the asymptotic analysis 
of the Painleve transcendent of the third kind [MTW] and two-dimensional Ising 
model [T]. It has also been used in approximating the resolvent of a certain more 
difficult operator in [TW4]. 

The spectral analysis of the kernel (2.29) for a = was carried out in [MTW], 
see also [T]. 

If a = then (3.3), (3.7a) turns into 



1 1 / x\ 

fo,m = - Wo^im{x) = —= Kim TT 
X ^/ttx \2/ 



Afom — ~i fo,m 

which agrees with the results of [MTW] (here K^{x) stands for the Bessel K- 
function). 

4. The matrix tail kernel 

In [P.III], we studied a 'tail kernel' associated to the Whittaker kernel. This is 
a translation invariant kernel on R generalizing the sine kernel. Specifically, it has 
the form 

B smjAjC - 77)) Bsh{A{C-ij)) 

A sh{B{C-v)) °' Ash{B{^-r^)) ^ ' ' 

depending on whether // is pure imaginary or real, respectively; A and B are certain 
constants depending on ^, z' (see also below). Here we aim to study a similar object 
for the matrix Whittaker kernel. 
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The proofs are omitted; they are quite similar to that given in [P.III]. For the 

sake of simplicity, we shall assume z ^ z' . 

Let us briefly recall how the tail kernel arises. According to [P-II], Theorem 
4.1.1, the Whittaker kernel 2/) behaves near (0,0) as follows 



sin (772;) sin (772;') 1 (x/y)' 



z — z 
2 



7rsin(7r(2; - z')) ^ (x/y)^ - (x/y)-^ 
In particular, on the diagonal, 

C 



(4.2) 



X 



where 



C = Ciz, z') = 



K_i__(_(a;, x) 

[z — z') sininz) sin(7r2') 



TT sin(7r(2 — z')) 



(4.3) 



We pass to new variables to make the density function Kj^j^ix, x) asymptotically 
equal to 1. Specifically, we take 



X 



y 



-ri/C 



Then the resulting kernel in ^, takes the form 

/C++(^,r7) + remainder term 

where the remainder term tends to zero as ^,77 — > +00 and A^++ is a translation 
invariant kernel equal to 1 on the diagonal. 



with 



^++(C,^) 



1 



1 MMi-ri)) 



B = — 



z-z' sh{B{^ - f])) 



TT sin(7r(z — z')) 



(4.4) 



2C 2{z — z') sin(7r2) s\n{Tiz') 
7rsin(7r(2 — z')) 



A={z- z')B = 



2sin(7rz) sin(7r2') 



(4.5) 
(4.6) 



Note that B is real and strictly positive while A is real or pure imaginary together 
with /X (so, for pure imaginary /x the kernel actually has the form of the first 
expression in (4.1)). 

Theorem 4.1. Application of the same procedure to the matrix Whittaker kernel 



K++ix,y) K+-{x,y) 
K-+{x,y) K — {x,y) 



K{x,y) 

leads to a translation invariant block kernel in ^, ri, 



(4.7) 
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(4.8) 



where all the blocks are real, 

}C++{tv)=}C-{tv), /C+_(e,r7) = -/C_+(77,0, (4-9) 
/C-|__|_ is as in (4.4) and 

/C+_ e, ^ = = 7 — ^ T,u ^ 4.10 

mt/i ^ and B as in (4.5), (4.6). 

I.e., in the new variables, the kernel (4.7) takes the form (4.8) plus a remainder 

term which tends to zero as ^,?7 — > +oo. 

Idea of proof. This claim is a generalization of Theorem 3.2 from [P.III] and is 
proved in the same way. In addition to (4.2) we employ an asymptotic formula for 
the kernel (x^y) near (0, 0): 

, , y^sin(7r2:) sin(7r2:') 1 sm{iTz){x/y)^^ + sm{Tvz'){x/y)~^^ 

j^+-{x,y) ~ 



7rsin(7r(2-2')) {x/y)^ + (x/y)-^ 

(4.11) 

which is proved similarly. □ 

Consider the integral operator in the Hilbert space of square integrable C^-valued 
functions on R that is defined by the kernel /C(^, r]). Since the kernel is translation 
invariant, the operator in question is a convolution operator. Under the Fourier 
transform it turns into the operator of multiplication by a 2 x 2 matrix-valued 
function, say, )C{u). 

Proposition 4.2. The above defined matrix function on M has the form 



lC{u) 



f{u) g{u) 
-9{u) f{u) 



(4.12) 



where f{u) is a real function, g{u) is a complex function, g{u) = g{u), 
f{u) = 2sin(7rz) sin(7r^') 



cos(7r(z — z')) + ch.{nu/B) 



, X I — ^ rCOs(7r(;z + ;z')/2 + *7rM/(25)) 

giu) = 2v/sin(7r2)sin(7r2') \\ , / \ • 

' V V ; V ; cos(7r(^-^')) + ch(W^) 

Sketch of proof . Rewrite the expressions (4.4), (4.10) in the form 

where k++ and k+- are functions of a single variable, say, It follows from the 
symmetry properties (4.9) that !C{u) has the form (4.12), where / and g are the 
Fourier transforms of k++ and k-\ , respectively: 

f{u) = J e-"^fc++(C)rfC, g{u) = J e^-<k+.{OdC. 

Since A;_|_+ is an even function, f{u) is real. 

The desired explicit expression for f{u) is a table integral, see, e.g., [E2, 1.9(14)]. 
The explicit expression for g{u) can be derived from another table integral, see [E2, 
3.2(15)]. □ 
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5. Degeneration to a Bessel-type kernel 
We shall need three Bessel functions: the Bessel function of the first kind 

''^^^^ - WTT) + -^^/'^ ) - r>TI) ^„ m!(. + iu ' 

the modified Bessel function of the first kind 

and the modified Bessel function of the third kind, also called the Macdonald func- 
tion 

K,{X) = / . (/-.(X) - I,{X)). 
2sm[nu) 

Here we assume X > 0. 

We fix the parameters zq, z'q satisfying the assumptions (2.2), and we set 

zq + z'q Zq - z'q 

In terms of ao, /U, the restrictions on zq, z'q take the form (2.4). 
Let A*" be an integer; then the parameters 

z = zq+N, z' ^z'q + N 

will also satisfy the same restrictions (2.2) as zq, z'q. We set 

z + z' 

and note that 



z — z' 



a = ao + N, — - — = fx. 
We introduce four functions in a positive variable ^: 

sm{'KZQ)J2^{2y/^) - sin(7r4) J_2^(2v^) 



sin(27r|U) 

i?(e)=K2M(2v^), 



where 



Atc^ rc sin(7r2;o) J^^(2^/e) - sin(7r4) 7^2^(2 V?) 
^^^^ = 

s(o = v^K^^(2v^), 
^'^^^'^ = ^^^^^ = Ix^""^^^- 



Note that 



1(0 = (4) ^(f), B«) = (4) 

because, for a function /(■), 

^^1) ^^^^^ = V^/'(2V^)- 



Finally, we let — > cxd and associate with the positive variables a;, y the 'scaled 
variables' ^,77, 

X = ^/N, y = ri/N. 
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Theorem 5.1. In the scaled limit, as N ^ +00 inside 2Z, the matrix Whittaker 
kernel in the variables x, y, 



^{^,y)- [K_+{x,y) K__{x,y) 
tends to a matrix kernel Jf'*"^ in the variables ^, rj with the following blocks: 

4 - ^ 

(C,r/) - - ^ , (5.1b) 

xLT(e,^) = -i^i!!!^(r7,0, (5.1c) 



Comments. 1) Under the shift zq i-^ zq + 1, z'q z'q + 1, the functions S, B 
remain stable while the functions A, A are multiplied by —1. It follows that under 
this shift, the diagonal blocks K^*^ are stable while the blocks K';^'^, 

are multiplied by —1. We could assume N tends to infinity inside Z (instead of 2Z) 

by introducing in the blocks i^T-i , K |. the extra factor (—1)^; such a factor does 

not affect the correlation functions. 

2) Note that the function B depends only on the parameter // while A depends 
on the both parameters gq, /x. This results in a strong asymmetry between the 
diagonal blocks and K^'^. Of course, these blocks are interchanged if we let 
N tend to — cxd instead of +00. 

3) When ^ is real and one of the parameters zq = + ^, Zq = ao — becomes 
integer, the kernel degenerates to the conventional Bessel kernel^ 

M2V^)VvJ:,{2^) - v/|4(2v/|) J42V^) _ 

- , u — ZjJ,. (<3-^J 

This agrees with the degeneration of the Whittaker kernel to the Laguerre kernel, 
see [P.III] , Remark 2.4.^ Thus, thanks to the parameter oq, the kernel provides 
a deformation of the Bessel kernel; one more new point is that the index fj, in the 
expression for can be pure imaginary. 

4) The kernel 

except the scalar factor const, depends only on n and looks quite similar to the 
Bessel kernel (5.2). One could call it the Macdonald kernel. 



2 About the Bessel kernel, see [F, NS, NW, TW2]. 

^It is well known that the Bessel kernel can be obtained in a scaling limit of the Laguerre 
kernel, see [F, NS, NW, TW2]. 
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5) The scalar factor const in (5.3) can be written in the form 

2 

const = (cos(27r//) — cos(27rao)). (5.4) 

TT 

This expression is periodic in oq with period 1. It is strictly positive (because of 
the assumptions on the parameters). When is fixed, its maximal value, attained 
at the point ao = 1/2, is equal to 4cos^(7r//)/7r^. 

Proof. Step 1: A transformation of the matrix Whittaker kernel. Recall the expres- 
sion of the Whittaker function through the confluent hypergeometric function: 



x-'/\^/'W^,,{x) = iFi(i - ^ + /i; 2/. + 1; x) 



T(2u)x-^ ^ 



(5.5) 



Let us abbreviate 



ip{x)^x-^'^e-/^W,^.^^{x), (5.6a) 

<p_{x) = x-''^e^/^W,_^^^{x), (5.6b) 

i^{x) = x-''^e-'^W_,^.^^{x), (5.6c) 

^l;.{x) = a;-V2e-/2i^_„_,^^(x), (5.6d) 

(p{x) — XLp'{x), 

iIj{x) = xip'{x). 
From (5.5), (5.6a,b,c,d) and the series expansion 

iFi{a;r,x) = 2^ . X 



we readily get 



m>0 ^''^ 



^_(x) = ^fel^^ 
zz' 

i(^{x) + a'4>{x) 



i})-{x) 



zz' 



Together with the definition of the matrix Whittaker kernel this implies 

^++^^^y)- r{z)T{z') x-y 

r{z)r{z')zz' x-y 

s_ 1 ip{x)ip-{y) -ip-{x)ip{y) 

e ^ — ^^^y)-Y{-z)r{-z') x-y 

^ 1 ip{x)i^{y) - '4^{x)i^iy) 

r{—z)r{—z')zz' x-y ' 
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(5.7a) 



(5.7b) 



X , ^ v/sin(7r2:)sin(7r2:0 (fi(x)i;{y) + zz'(fi_{x)ip_{y) 
' TT X + y 

•\/sin(7r2;) sin(7r2;') 

TT 

- + (l - ^) ¥'(a^)V'(y) + ^lp{x)^{y) 

X ^ ^ . (5.7c) 

x + y 

Step 2: The scaling limit of the functions (p, tp, i/j, i/j. We start with the well- 
known limit formula, which is readily obtained from the standard series expansions 
for iFi and o^i: 

lim ^F^ (a-r,-) =oi^i(7;0- (5-8) 

|a|— *-oo \ a J 

Here a, 7, ^ are allowed to be any complex numbers with the only restriction 
7 7^ 0,-1,— 2,.... The convergence is uniform on compact sets in the ^-plane, 
which implies that this limit relation can be differentiated with respect to ^. 
It follows that 

T(-2n)x^' ^ , 



r(— a — n) 

T{-a-n)N^' 
r(-2Ai)r(2/i+l) 



oFi(2//+l;-e) 

oFi(2//+l;-0 



(5.9) 



V{-a-^Ji)N^' r(2;U + l) 

Here we have used the relations z — a-\- jjL^ a N, 

n-wni +w) = - 7 , , + const,) ^ 

^ ^ ^ ^ sin(7r'u;) ' r{N + const2) 

and the expression of the Bessel function J^, through the qFi function. 
Likewise, 

r(-2u)x^ ^ , ^ . ^ 



r(a — /i) 

r(-2/i)r(2/x + i) 



T{a - iJi)Nf' r(2// + 1) 

1 TT 



oFi(2/x+l;e) (5.10) 



r(a) sin(27r|u) 



By the definition (5.6a) of the function p{x) and the expression (5.5) for the 
Whittaker function, (p{x) is equal to the left-hand side of (5.9) plus the symmetric 
expression obtained by inserting —ji in place of ji. Then it follows from (5.9) that 

/ ^ ^/ ^ f sin(7r2;) ^ ,^ sin(7r2') ^ /tx\ 

Vsm(27r//) sm(-27r//) J (5.11a) 
= r(a + l)A(0. 
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Here we have used the definition of ^(^) and the fact that 



a — n = z' , sm{nz) = sin(7r2o + ti"-^) = sin(7r^o)) sin(7r^') = sin(7r2o) 

because A?" e 2Z by assumption. 

Likewise, it follows from (5.6b), (5.5) and (5.10) that 

r(a) Vsm(27r^) ^ sm(-27r//) J ^^^^ 



Recall that our asymptotic formulas, which are based on the limit formula (5.8), 

A. 

dx 



are stable under differentiation and note that the differential operator x-^ is in 



variant relative to the change of a variable x ^ ^ — xN . It follows that 

!f(x) = U^) f(x) ~ r(o + 1) (? ^) A{0 = r(o + 1)1(0, (s.iic) 

^(x) = (.A) ^(,) . (j|) Bii) = ^BK). (5.11d) 

Ste-p 3: The scaling limit of the matrix Whittaker kernel. It remains to combine 
the formulas (5.7a,b,c) with the asymptotic expressions (5.11a,b,c,d). 

First of all, note that the transformation of a kernel in x,y under a scaling 
involves the transformation of a differential, say, dy. We have 

dy dr] 



x±y ' 

so that in the scaling limit, the denominator x ±y simply turns into ^ ± ?]. Next, 
in the scaling limit, the exponential factor in the left-hand side of the formulas 
(5.7a,b,c) is negligible. 

Inserting the asymptotic expressions for (p and into (5.7a) and using the rela- 
tion 

r(a + l)r(a + l) ^ ^ 
T{z)T{z')zz' 

we get the desired formula (5.1a). 

Likewise, inserting the asymptotic formulas for if) and ifj into (5.7b) and using 
the relation 

4 4sin(7rz) sin(7rz') 

T{-z)r{-z')zzT{a)T{a) ^ 

4 sin(7r2o) sin(7r2o) 



7r2 



we get the formula (5. Id). 

Now, let us examine the numerator in (5.7c), 



zz' 
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Note that each of the functions ip{-), ip{-) is asymptotically equivalent to a function 
in a scaled variable times the factor r(a + l), while each of the function '(/'(■), is 
asymptotically equivalent to a function in a scaled variable times the factor l/r(a). 
It follows that each of the three expressions in the squared brackets behaves as a 
function in the scaled variables ^,77 times the factor r(a + l)/r(a) ~ A^. 
Further, the coefficients behave as follows 

-^ = ^^^N-\ 1 - i4 = 1 - = 0(Ar-2), = = o(N-^). 

zz' a^—^i^ ' zz' a^— /i^ \ zz' a^—fi^ ^ ' 

This implies that the second and the third summands in (5.12) are asymptotically 
negligible. It is readily verified that the contribution of the first summand yields 
the desired formula (5.1b). 

Finally, the relation (5.1c) is immediate from the similar relation between the 
blocks of the matrix Whittaker kernel. 

This concludes the proof. □ 
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